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© Television transmission sysxem using transmission of basic picture weighting factors. 


© 


® In a television transmission system for digital picture signals each picture is partitioned into sub-pictures of 
N1XN2 pixels for limiting the bit rate. Each sub-picture is subtected to a forward picture transform for generating 
basic picture weighting factors. To this end each sub-picture is multiplied by a reference picture which has 
different values for different pixels (for example, as described by a Gauss function). This multiplied sub-picture is 
subsequently multiplied by a number of kernel pictures so that the said basic picture weighting factors are 
obtained. Each kernel picture is equal to the product of the reference picture and a basic picture. Of the 
collection of basic pictures each basic picture is an orthogonal polynomial associated with the square value of 
the reference picture. For regaining the original sub-pictures each weighting factor is multiplied by the original 
kernel picture from which the weighting factor is obtained. Each weighting factor of a sub-picture thus supplies 
an auxiliary sub-picture. Summation of all auxiliary sub-pictures yields a replica of the original sub-picture. 
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Television transmission system using transmission of basic picture weighting factors. 

A. Background of the invention 


A(1) Field of the invention 

5 

The invention generally relates to a television transmission system for transmitting television pictures in 
a digital format from an encoding station to a decoding station via some transmission medium. 

More particularly, the invention relates to a television transmission system in which the encoding station 
comprises a picture transform circuit for performing a forward transform to generate so-called basic picture 
70 weighting factors and in which the decoding station comprises a weighting factor transform circuit for 
performing an inverse transform. 

Such a television system may form part of a television broadcasting system, in which case the 
encoding station forms part of the television broadcasting transmitter and each TV receiver is provided with 
a decoding station. In this case the transmission medium is the atmosphere. 
75 Such a system may also form part of a video recorder, in which case the video tape is the transmission 
medium. 


A<2) Description of the prior art 

20 

In picture encoding it is common practice to consider a picture as a matrix of E1XE2 pixels each having 
a given luminance and colour, if any. It will hereinafter be assumed that the picture only comprises half 
tones and the luminance of a pixel will be indicated by means of the pixel value. When digitising such a 
picture, a number (in a binary form) is assigned to each pixel. This number may indicate the pixel value 

25 itself, or. for example the difference between the pixel values of two contiguous pixels, in the former case a 
digital picture in a canonical form, or shortly a canonical picture is concerned. 

If 8 bits are used for representing the pixel value of a canonical picture, this means that a conventional 
canonical picture of S76 x 720 pixels requires approximately 3 x^10^ bits for its representation, which with a 
transmission of 25 pictures per second ieads to a bit rate of approximately 75 x 10^ bits/second. Generally, 

30 this is unacceptably high. The object of the encoding station is to convert this canonical picture into a non- 
canonical picture which can be represented with a considerably lower number of bits. 

Different methods are known for this conversion, for example the above-mentioned method in which a 
number is assigned to each pixel, indicating the difference between the pixel values of two contiguous 
pixels. This method is known under the name of Differential Pulscode Modulation, abbreviated DPCM. 

35 Another method is to subject the canonical picture to a forward picture transform. To this end the picture is 
partitioned into sub-pictures of N1XN2 pixels each, which are each considered as a sum of mutually 
orthogonal basic pictures Bq^r also of Ni x N2 pixels each and each with its own weighting factor Y(Bq,r)- As 
a result of the correlation between the pixels of a sub-picture the information is concentrated in a limited 
number of basic pictures. Only the associated weighting factors are important and the other weighting 

40 factors can be ignored. 

To determine the weighting factors, Ni is generally taken to be equal to N2 in practice and a sub- 
picture is mathematically considered as an N x N matrix X and the weighting factors are also an^anged in 
accordance with an N x N matrix which will be denoted by Y. Furthermore, an orthogonal N x N -transform 
matrix A is defined which is related to the chosen collection of basic pictures Bq,r. More particularly it holds 

45 that: 

(1) Bq., = Aq A[ 

Here Aq represents an NxN matrix in which each column is equal to the q-th column of the transform matrix 
A and aJ represents a matrix each row of which is equal to the r-th row of the matrix A. The said weighting 
factors now follow from the matrix multiplication 
50 (2) Y = A"^ X A 

In this expression A""" represents the transposed matrix of A. 

For more information on the above, reference is made to Reference 1 . 

The number of weighting factors which must be transmitted appears to be closely related to the 
structure of the chosen basic pictures and, in conjunction. therewith the chosen transform matrix A. In this 
connection the Karhunen-Loeve transform matrix (see for example Reference 2, pages 259-264) is found to 
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vfB^is difficult to implement. Nowadays the dis^^^c 


be optimum. HowevHiris difficult to implement. Nowadays the disciSfe cosine transform, abbreviated DCT 
is generally considered to be the best alternative (see Reference 2). 

In practice it is found that the number of weighting factors qualified for transmission may greatly differ 
from sub-picture to sub-picture. To be able to make a selection, all coefficients must always be calculated. 

5 

B. Object and summary of the invention 

The invention has for Its object to provide a television transmission system of the type described above 
10 in which only those coefficients are determined which are qualified for transmission. 
According to the invention 
- the picture transform circuit for performing the fonward transform is adapted: 

i) to multiply each sub-picture by a reference picture having different values for different pixels so 
that each time a product sub-picture is obtained; 
75 ii) to multiply each product sub-picture by a number of kernel pictures for generating a number of 

blocks of product element values corresponding to the number of kernel pictures, each kernel picture being 
equal to the product of the reference picture and a basic picture from a collection of basic pictures each 
being formed by an orthogonal polynonnial associated with the square of the reference picture; 
lii) to add the product element values of a block for generating a weighting factor; 
20 ' the weighting factor transform circuit for performing the inverse transform is adapted: 

iv) to multiply each weighting factor by a kernel picture for generating a number of auxiliary sub- 
pictures; 

V) to sum the auxiliary sub-pictures obtained; 

vi) to divide each auxiliary sub-picture obtained by a correction picture which is equal to the sum of 
25 versions of the reference picture shifted over the sub-picture. 


C. References 

30 
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IEEE Transactions on Communications. Volume COM- 32. No. 3, March 1984, pages 225-232. 



40 


D. Explanation of the invention 


45 D(1) Brief description of the Figures 

Fig. 1 shows diagrammaticaily a video recorder provided with the television transmission system; 
Fig. 2 shows an embodiment of a picture transform circuit for performing a forward transform: 
Fig. 3 shows a partitioning of a picture into sub-pictures and 
50 Rg. 4 shows an embodiment of a weighting factor transform circuit for performing an inverse 

transform. 


0(2) General structure of the television transmission system 

Fig 1 shows diagrammaticaily a video recorder provided with the television transmission system 
according to the invention. It comprises an encoding station COD and a decoding station DECOD, The 
encoding station receives a video signal s{t) which is supplied by a picture signal source PS, for example a 
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video camera. The signal zG) supplied by the encoding station COD is recorded on a magnetic tape TP via 
a modulator circuit .MOD and a write head WH. To regain the original picture signal, the information 
recorded on the magnetic tape is converted by a read head RH into an electric signal which is applied to 
the decoding station DECOD after demodulation in a demodulator MOD~V This decoding station supplies 

5 an analog picture signal s (t) for a monitor MON. 

In the encoding station COD the analog picture signal s(t) is sampled in an anaiog-to-digital converter 1 
at 2 suitably chosen sampling frequency U of, for example 13.5 MHz and the picture signal samples thus 
obtained and conventionally referred to as pixel values are encoded in. for example 8-bit PCM words s(n). 
These amplitude-discrete pixel values are subsequently applied to a picture transform circuit 2 for 

70 performing a forward transform. It supplies a block of weighting factors which are simultaneously available 
at a number of parallel outputs 2(1). These weighting factors are further applied to an encoding circuit 3 for 
quantisation and encoding. The encoded weighting factors supplied thereby via parallel outputs 3(1) are 
converted into a serial sequence in a multiplex circuit 4. 

In the decoding station DECOD the signal supplied by the demodulator MOD"' is converted in a 

75 demultiplex circuit 5 into blocks of associated weighting factors which occur at parallel outputs. Each block 
is in turn applied to a decoding circuit 6 for decoding the separate weighting factors in the block and 
subsequently applied to parallel inputs 7(1) of a weighting factor transform circuit 7 for performing an 
inverse transform. This circuit supplies a series of signal samples s (n) which are converted in a digitai-to- 
analog converter 8 into the analog picture signal s (t) which can be displayed on the monitor M. 

20 

D(3) The transform" circuits 

An embodiment of the picture transform circuit 2 for performing a forward two-dimensional transform is 

25 shown in Fig. 2. It comprises a sub-picture forming circuit 20 constituted by two picture memories 21(1) and 
21(2). These memories have addressable memory locations and are controlled by write-read commands 
V/R(1) and WR(2) in such a way that the pixel values s(n) of the pixels of the lines of two successive fields 
of a picture are written in one of them, whilst simultaneously the pixel values of the lines of the two fields of 
the previous picture, which values are stored in the other picture memory, are read. The address words AD- 

30 (1) and AD(2) which are applied to the address inputs of these picture memories determine at which 
location in the picture memory a pixel value is stored or which pixel value is read. 

More particularly, only the pixel values of the visible pixels of the visible lines of a picture are written in 
the picture memory, namely line by line. After all pixel values of a picture are thus written in the picture 
memory, it comprises, for example the pixel values of the pixels denoted by dots in Fig. 3. In this Fig. 3 the 

35 row numbers LN of the picture memory in which pixel values are written are plotted vertically and the 
column numbers PN of the picture memory in which pixel values are written are plotted horizontally. On 
reading the contents of the picture memory, each picture is partitioned into sub-piciures of NxN pixels. 
Such a partitioning is diagrammatically shown in Fig. 3 for N = 8. More particularly it has been assumed for 
the sake of clarity of the Figure that the sub-pictures adjoin one another. However, in practice it is found to 

40 be advantageous if the sub-pictures partly overlap one another. It is to be noted that the write-read 
commands and the address words can be generated in the conventional manner by means of a control 
circuit 24. 

The pixel values of a sub-picture will hereinafter be denoted by X(i,k) with i,k = 1 ,2, ...N in this case. 
These pixel values X(i,k) are applied row by row to a multiplier circuit 22. In this circuit the sub-picture is 
45 multiplied by a reference picture which will be denoted by V(i.k) and which consists of NxN pixels. This 
multiplier circuit 22 supplies a product picture PRD(i,k) for each sub-picture. More particularly it holds that 
(3) PRD(i.k) = X(i,k) . V(i,k). 

The product picture PRD(i,k) thus obtained is subsequently applied to a bank of multiplier circuits 23 
comprising a number of multiptie and adder circuits; for example Q.R. In each multiplier and adder circuit 
50 the product picture PRD(i,k) multiplied by a kemel picture D\r(i.k); in which q = 0,1 ,2,...Q-1 and 

r = 0,1,2 R-1. Each multiplier circuit supplies product element values which are added in an associated 

adder circuit. Multiplier and adder circuit with kernel picture Dq jli,k) now yields the wanted weighting 
factor Y(Bq,r) of the basic picture Bq.r- The collection of kernel pictures used in this case is now chosen to 
be such that this collection is orthonormal, which means that 

55 
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rqlT^q: 
-0 if { 


[1=q2 

'1 if 


C1=q2 
1=r2 


while furthermore each kernel picture is equal to the product of the reference picture and a basic picture. 
More particularly it now holds that the basic pictures Bg., are orthogonal polynomials which are associated 
with the square value of the reference picture chosen; in other words 
(5) D-p,,(i,k) = B<,,r(i,k) V(i.k) 



oO -0 if 
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Crl 


tx2 


(6) J jV^ii.k) B(j^^^^(i,k) Bq2,r2 

1 If 


S:1=r2 


An embodiment of the weighting transform circuit 7 for performing an inverse transform in order to 
obtain a good approximation of tiie original sub-picture from each group of transmitted weighting factors Y- 
(Bq.r) is shown in Fig. 4, It comprises Q.R input leads 7(0,0) to 7(Q-1,R-1). Input lead 7(q.r) receives the 
transmitted weighting factor /(B^.r). Each input lead 7(q,r) incorporates a pattern picture generator 70(c.r) 
which supplies the auxiliary sub-picture Cq,r(i,k) which is equal to the product of the weighting factor Y(BqJ 
and the kernel picture D'q.r(i.k). The auxiliary sub-pictures thu3 obtained are added in^ an adder circuit 71 
which thereby supplies an auxiliary sum sub-picture from which a local sub-picture X (i,k) is produced oy 
division by a correction picture W(i,k) in a divider circuit 75 and which is a reconstructed version of the 
original sub-picture. 

More particularly this correction picture is equal to the sum of all reference pictures associated with the 
different sub-pictures. Or in mathematical terms: 
^0 (7) W(i,k) = g g V(i-pTi, k-qT2) 

in which Ti and T2 represent the distances between the successive sub-pictures in the horizontal and 
vertical directions. 

The reconstructed sub-picture X (i,k) thus obtained is stored in a picture memory 72. more specifically 
in such memory locations as correspond to the location which this sub-picture had in the original picture. 
This picture memory thus comprises an auxiliary picture consisting of 576 x 720 pixel values in which only 
those pixel values differ from zero which correspond to the last supplied reconstructed sub-picture X (l,k). 
All sub-pictures which are obtained on the basis of the reconstructed sub-pictures of a picture are 
accumulated in an accumulator circuit 73. In this embodiment this circuit is formed by an adder 73(1) which 
receives the pixel values from the picture memory 72 on the one hand and which receives pixel values of 
corresponding pixels from either a picture memory 73(2) or a picture memory 73(3) on the other hand. The 
sum of the two pixel values is written in picture memories 73(2) and 73(3), respectively. These picture 
memories can be connected to an input and to the output of the adder 73(1) in the manner shown in the 
Figure by means of switching devices 73(4) and 73(5) which are shown diagrammatically. These picture 
memories 73(2) and 73(3) are provided with addressable memory locations and are controlled by write-read 
commands WR(3) and WR(4) in such a way that the locations of one of the picture memories are 
addressed one after the other and line by line, whilst the pixel value stored in the addressed memory 
location is applied via switching device 73(4) to the adder 73(1) for generating a pixel sum value which is 
subsequently applied via switching device 73(5) to the same picture memory and is stored in the same 
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memory location. Simultaneously, the pixel values which are present in the other picture memory at that 
moment are read one after the other and line by line and are applied as signal samples s (n) via switching 
device 73(4) to its output. The address words AD(3) and AD(4) determine at which location in such a picture 
memory 73(2), 73(3) a pixel value is stored or which pixel value is read. Like the write-read command and a 

5 selection signal S controlling the switching devices 73(4). 73(5), they are generated by a control circuit 74 in 
the conventional manner. It is to be noted that whenever the selection signal S connects the input and the 
output of a picture memory to the output and the input, respectively, of the adder, the picture memory is 
also erased. As may be apparent from the foregoing this takes place whenever the first weighting factor of 
the first sub-picture of a picture is received. 

10 A picture whose pixel values of the different pixels is described by a function which is an accurate 
description of the sensitivity characteristic of the eye is preferably chosen as a reference picture. Such a 
function is the Gauss function. A two-dimensional Gauss function for a two-dimensional reference picture is 
defined as follows. 
(8) V(i,k) = V(i).V(k) 


15 


(8a).,. V(x) = 7=4=se"^^/^2cr2) 
y a /TP 

20 

The basic pictures Bq,r associated with this reference picture are known as the two-dimensional Hermite 
polynomials which are defined as follows: 

(9) H,,,(i.k) = Hq{i).H,(k) 

2s (9a)... H^(x) = e^^^^^ dllL ( J_ e-^^/^^ 

The kernel pictures D*q.r(i,k) now represent the two-dimensional Hermite functions. They are defined as 
30 follows: 

(10) Dq .,(';.k) = Dq (i) . D'r (k) 

(10a).., D^(x) =7=^. "T^^m^'"^ e-^^/tSCT^) 

For the correction picture W(i,k) it then holds that: 

(11) w(i,k) = W(i) . W(k) 
(11 a) W(x) = ^ V(x-mT) 

in which T is the distance between successive sub-pictures and a is a constant. 

Another function which is closely related to the sensitivity characteristic of the eye is the binominal 
function. On this basis a reference picture can be defined whose pixel values of the different pixels are 
defined as the square root of the binominal coefficients. The associated basic pictures are described by so- 
called Krawtchouk polynomials. 


50 


D(4) Genera! remarks 


In the embodiment of the picture transform circuit 2 which is shown in Fig. 2 the sub-picture X(i,k) is 
first multiplied by the reference picture V(i,k) and subsequently the product picture PRD(i,k) = X(i,k) V(i,k) 
is multiplied by each of the kernel pictures D''q,r(irk) in the multiplier and adder 23(q.r). It will be obvious to 
those skilled in the art that this multiplier and adder can be formed in such a way that its original function is 
interwoven with that of multiplier circuit 22; in other words, the mathematical operation 

(12) Y(Bq,) = f ^ Bq.r(i,k) V2(j,k) X(i,k) 

is directly performed therein. 

in a corresponding manner the function of the divider circuit 75 in the weighting factor transform circuit 
7 which is shown in Fig. 4 can be interwoven with that of the pattern picture generator 70(p,q) such that its 
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inree-dimensionai 


Claims 


sub-pictures of Nivn r.-.^ . ^ station, the encodina station 
3- An encoding sta«o, Senerafmg a 



3. A decoding station as claimed in Claim 6, characterized in that the pixel values of the different pixels 
of the reference picture are described by a Gauss function and in that the pixel values of the different pixels 
of each of the basic pictures are described by a discrete band-limited Hermite polynomial. 

9. A decoding station as claimed in Claim 6. characterized in that the pixel values of the different pixels 
qI reference picture are described by the square root of the binominal coefficients and in that the pixel 
vaiues of the different pixels of each of the basic pictures are described by a Krawtchouk polynomial. 
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